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FIELD OF THE INVENTION 
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Theinventionrelatesgenerallytothefieldof .g ^^^^^^^^^^^ ^^^^^^ 

invention particularly provides a system and ^^^j' 
computers, or the like. 

BACKGROUND OF THE INVENTION 



22 
23 
24 
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for executing those processes. 

. 1 A fnr «!cheduling execution of processes 
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1 until all are completed. However, batch-queuing generally precludes sharing of the computer in an 

2 interactive manner. 

3 In another methodology, referred to as "gang scheduling," the computer also executes 

4 processes of only one parallel program at a time, but allows for interactivity. In a computer which 

5 implements the gang scheduling methodology, a master entity, forming, for example, part of the 

6 operating system, periodically determines which parallel program to schedule at any point in time. 

7 Preferably, the master entity will make such determinations at frequent, regular intervals. At the 

8 beginning of each interval, the master entity selects which parallel program is to be processed during 

9 the interval, and allow all of the processes of only the selected program to be executed during the 

o 

ffi interval. At the end of the interval, the master entity will stop execution of that program and select 

J3 another program to be executed. This methodology allows for interactivity with the various 

i4 programs being executed, but the master entity adds a not-inconsiderable amount of processing 

' iil overhead. The overhead can be reduced by making the intervals longer. However, if the intervals 

f4 are made longer, the interactivity response time can be relatively poor. In addition, with this 

y methodology it is not possible to process two parallel programs that communicate with each other 

M since they will never be scheduled for execution at the same time. 

^ In a third methodology, referred to as "co-scheduling," each process, while it is being 

18 executed, determines for itself whether it is to be scheduled for execution, or to de-schedule itself 

19 The processes can make the determination based on a number of factors, such as, for example, its 

20 communication pattems, responsiveness of other processes to requests, whether it is waiting for 

2 1 information from another process, and the like. For example, if a process determines that it has been 
• 22 waiting too long for information from another process, it (that is, the waiting process) can de- 

23 schedule itself, so that it will not be executed. This allows execution of other processes, which are 

24 not similarly waiting for information and which therefore can make progress in their processing 

25 operations. Since each process determines whether it is to be scheduled, no master entity is required 

26 to make such scheduling decisions. In addition, since a computer can be executing the processes 
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1 comprising multiple programs, the methodology allows for a high degree of interactivity and 

2 execution of multiple parallel programs that communicate with each other, 

3 Summary Of The Invention 

4 The invention provides a new and improved system and method for efficiently controlling 

5 scheduling of execution of processes or threads comprising one or more parallel programs in a 

6 computer having a plurality of processors, such as a computer constructed according to a symmetric 

7 multi-processor architecture or a cluster of such computers. 

M In brief summary, A system is described for controlling co-scheduling of processes in a 

W 

;3 computer comprising at least one process and a spin daemon. Each process, when it is waiting for 

: 5 3 

ft a flag to change condition, can transmit a flag monitor request to the spin daemon and enable itself 

* y to be de-scheduled. The spin daemon, after receiving a flag monitor request, monitors the flag and, 

12 after the flag changes condition, enables the process to be re-scheduled for execution by the 

B computer. 

y Since the spin daemon can monitor flags for a number of processes, the ones of the processes 

O that are waiting will not need to be executed, allowing other processes that are nof just waiting to 

1 6 be processed more often. 

1 7 Bmef Description Of The Drawings 

18 This invention is pointed out with particularity in the appended claims. The above and 
,19 further advantages of this invention may be better understood by referring to the following 
20 description taken in conjunction with the accompanying drawings, in which: 
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1 FIG. 1 schematically depicts a computer system including an arrangement for efficiently 

2 controlling scheduling of processes or threads comprising one or more parallel programs in a 

3 compute having a plurality of processors, constructed in accordance with the invention; and 

4 FIG. 2 is a flowchart depicting operations performed by the scheduling control arrangement 

5 in the computer depicted in FIG. 1 . 

6 Detailed Description of an Illustrative Embodiment 

7 FIG. 1 schematically depicts a computer 10 including an arrangement for efficiently 
controUing scheduling of processes or threads comprising one or more parallel programs in a 
compute having a plurality of processors, constructed in accordance with the invention. Generally, 

1 QJ the computer 10 includes hardware resources which are preferably constructed along the lines of a 

1 §\ symmetric multi-processor architecture, in which a plurality of processors (not separately shown) 

1 T share common memory resources (also not separately shown), or a cluster of such computers. In the 

IP computer 10 depicted in FIG. 1, a plurality of programs 1 1(1) through 1 1(N) (generally identified 

IM by reference numeral ll(n)), each comprising one or more processes 12(1)(1) through 12(N)(M) 

1^ (generally identified by reference numeral 12(n)(m)). The processes 12(n)(m) share a common 

1^ memory 13, with each process being allocated a portion 13(n)(m) of the memory 13. The total 

17 number of processes which the computer system 10 will execute may be greater than the total 

1 8 number of processors in the computer system 1 0, and, if so, the computer's operating system 1 4 will 

19 enable the processes to be executed in a series of time intervals or slots, with the particular ones of 

20 the processes that be executed during a time slot being listed on a task list 15. When a process 

21 12(n)(m) is listed on the task list, it can be "scheduled" for execution, on the other hand, when a 
' 22 process 1 2(n)(m) is not listed on the task it has been "de-scheduled" and the operating system 1 4 will 

23 not enable it to be executed until it is again scheduled. At the end of each time slot, the operating 

24 system selects the processes that are to be executed from among those that are listed on the task list 

25 15. 
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1 As noted above, each process 12(n)(m) is allocated a portion 13(n)(m) of the common 

2 memory 13, which it will normally use in its processing operations. Each process 12(n)(m) can, 

3 however, communicate with another process 12(n')(m') (where one or both of "n'" and "m"' will 

4 differ from "n" and "m") by sending messages thereto. The messages effectively result in the storing 

5 of information in the memory portion 1 3(n*)(m') of memory 1 3 allocated to that process 1 2(n')(m'). 

6 A process may communicate with another process for several reasons. For example, a process may 

7 communicate with another process to request that the other process provide it with information 

8 which it may need in its processing operations. In that situation, after the process receiving the 

9 processing request, it (that is, the process which receives the processing request) will at some point 
]A perform the processing operations to generate the requested information. After the information has 
1^ been generated, the process which generated the information can provide the information to the 

0 process that generated the request. In both cases, the process loads information (either the 

1 § information generation request or the generated information) into the memory portion of the process 

which is to receive the information. Thus, if one process 12(n)(m) is requesting information from 
lj5 another process 12(n*)(m% it (that is, process 12(n)(m)) will load the request into the memory 
portion 13(n')(m') associated with the other process. Similarly, if one process 12(n)(m) is loading 
information requested by another process 12(n*)(m'), it (that is, process 12(n)(m) will load the 
1^' requested information into the memory portion 13(n*)(m') associated with the other process. In 

1 9 addition, if the information is in response to a request, the process 1 2(n)(m) will set a flag 1 6(n')(m*) 

20 in the memory portion 1 3 (n')(m*) to indicate that it has stored the information in the memory portion 

2 1 1 3(n')(m*). Thereafter, the process 1 2(n')(m') can make use of the information that has been loaded 

22 into its memory portion 13(n*)(m') by process 12(n)(m) and, at some point, reset the flag 16(n')(m'). 

23 If the process 12(n')(m*) is waiting for information from the process 12(n)(m), which may 
.24 occur after it issues a processing request to the process 12(n)(m), it (that is, process 12(n')(m')) will 

25 perform a "spin- wait" loop in which it periodically tests the flag 16(n*)(m'). While performing the 

26 spin-wait loop, the process 1 2(n')(m') will need to delay performing other processing operations until 

27 the process 12(n)(m) has loaded the information in its memory portion 13(n')(m') and set the flag 
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1 1 6(n')(m'). It will be appreciated that, while the process 12(n')(m*) is in the spin-wait loop, it is not 

2 performing processing operations, and so time that it is performing the spin-wait loop will essentially 

3 be wasted. The process 12(n)(m) may be delayed in providing the information required by process 

4 12(n')(m*) for a number of reasons, including, for example, that it is not being executed by the 

5 computer 1 0 in the current time slot, that it is not scheduled for execution, that the process 1 2(n)(m) 

6 needs a relatively long time to generate the information to be provided, and other reasons which will 

7 be apparent to those skilled in the art. To reduce the amount of processing time that may be wasted 

8 by the process 12(nO(m*) executing the spin loop, the computer 10 also includes a spin daemon 17 

9 which, after receiving a flag monitor request therefor from the process 12(n')(m'), can monitor the 
condition of the flag 16(n')(m') for the process 12(n')(m'). The process 12(n')(m'), after issuing the 
flag monitor request to the spin daemon 17, can thereafter de-schedule itself, by removing its 

Q identification from the task list 15, and provide a notification to the operating system 14 giving up 

i ! £ 

]@ any remaining portion of its current time slot. After the process 12(n*)(m*) gives up any remaining 
portion of its time slot, the operating system 14 can initiate execution of another process 12(n*')(m") 
i 5 (where one or both of n" and m" will differ from n' and m') during that time. In addition, since the 

i — = 

p process 12(n')(m*) has de-scheduled itself, the operating system 14 will not again enable the process 

g 1 2(n')(m*) to thereafter be executed. 

M After receiving the flag monitor request from the process 1 2(n*)(m'), the spin daemon 1 7 will 

1 9 add the flag monitor request to a spin list 1 8 which it maintains. The spin list 1 8 identifies the flags 

20 in memory whose condition it is to monitor. Accordingly, after the spin daemon 17 adds the flag 

21 monitor request to the spin list 18, it will thereafter monitor the condition of the flag 16(n')(m*). 

22 When the process 1 2(n)(m) sets the flag, indicating that it has provided the information required by 

23 process 12(n*)(m'), the spin daemon 17 will enable the process 12(n')(m') to, in tum, enable the 
.24 operating system 14 to re-schedule the process 12(n*)(m*) by re-loading its identification on the 

25 operating system task list 16. The operating system 14 can thereafter enable the process 12(nO(m') 

26 to be executed in the same maimer as before it had de-scheduled itself Since by the time the process 

27 12(n')(m') is re-scheduled, the process 12(n)(m) will have provided the information required by 
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1 process 12(n*)(m*), it (the process 12(n*)(m*)) will be able to make progress in its processing 

2 operations, using the information provided by the process 12(n)(m), and will not need to return to 

3 spin-wait loop. 

4 It will be appreciated that the spin daemon 1 7 may be implemented in the form of a process 

5 or thread (generally, "process"), and will essentially be performing a spin-wait operation in 

6 connection with the flag 1 6(n*)(m') associated with the process 1 2(n')(m') that issued the flag monitor 

7 request. However, the spin daemon 1 7 can perform these operations in coimection with flag monitor 

8 requests from a number of processes, in which case only the one process (namely, the process 

9 associated with spin daemon 17) will be performing these operations instead of a plurality of 
1|[ processes. Accordingly, spin daemon 17 would not waste any more processor time than would 
ii" having a single process, such as process 12(n')(m') described above, perform the spin-wait 
U operations, and it can result in less waste if a number of such processes are waiting for information 
\% from other processes. For example, continuing with the above example, if process 12(n")(m") is 
A waiting for information from process 1 2(n*)(m'), and process 1 2(n"')(m"*) is waiting for information 

from process 12(n")(m"), then three processes, namely, processes 12(n')(m'), 12(n")(m") and 

IjS 1 2(n"')(m"') would, in the absence of the spin daemon 1 7, be performing spin-wait operations waiting 

; S 

for the required information during the time slots in which they are executed. With the use of the 
spin daemon 17, only one process, namely, that associated with the spin daemon 17 itself, will be 

19 performing these operations, and the processes 12(n')(m'), 12(n")(m") and 12(n'")(m"') will not be 

20 scheduled until the information that they require has been provided to them. 

2 1 In addition, the process for the spin daemon 1 7 can be executed at a lower priority level, that 

22 is, less often, than the processes 12(n)(m) of the programs ll(n), and, as long as the number of 

23 processes 1 2(n)(m) which have not de-scheduled themselves and therefore can be executed is greater 

24 than or equal to the number of processors comprising the computer 1 0, the computer can still make 

25 progress in connection with processing of those programs. If the number of processes 12(n)(m) 

26 which have de-scheduled themselves, and which will not be executed, increases to a point at which 

27 the number which can be executed falls below the nimiber of processors, both the processes 1 2(n)(m) 
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1 that are still executing and the spin daemon 17 will be accommodated by the processors, in which 

2 case the spin daemon 1 7 will be executed more often. 

3 In one embodiment, in which the operating system 14 is in the form of Unix or a Unix-like 

4 operating system, the processes 1 2(n)(m) and spin daemon 1 7 conmiunicate over respective sockets. 

5 In that embodiment, each process 12(n)(m) initially requests the operating system 14 to establish a 

6 socket between it (that is, the process 1 2(n)(m)) and the spin daemon 1 7 . After the operating system 

7 has estabUshed the socket, the process 12(n)(m) performs a registration procedure with the spin 

8 daemon 17, in which it (that is, the process 12(n)(m)) provides the spin daemon 17 with its 

9 identification and information such as the address of its flag 16(n)(m) in the common memory 13, 

11 and the spin daemon 17 returns an identifier or handle that the process 12(n)(m) can use in flag 

12 monitor requests to the spin daemon 1 7. Since sockets are used as the communication mechanisms 
iJ between the processes 12(n)(m) and spin daemon 17, when the spin daemon 17 has no outstanding 
1^ flag monitor requests from the processes 12(n)(m), it (that is, the spin daemon 17) can de-schedule 
ft itself so that the operating system 1 4 will not enable it to be executed, and, when a process 1 2(n)(m) 
y issues a flag monitor request over its respective socket to the spin daemon 1 7, the operating system 
L6 1 4 will enable the spin daemon 1 7 to be executed, at which point the spin daemon 1 7 can enable the 
S operating system 14 to re-schedule it for execution. Similarly, after a process 12(n)(m) has de- 
1% scheduled itself as described above, when the spin daemon 17 determines that the condition of its 

1 9 flag 1 6(n)(m) has changed, it (that is, the spin daemon) will transmit a request over the socket, which 

20 will enable the operating system 1 4 to resume execution of the process 1 2(n)(m), which at that point 

2 1 will enable itself to be re-scheduled as described above. 

22 In that same embodiment, the spin daemon 17 also provides, for each flag monitor request 

23 which it loads in the spin list 18, a time stamp that identifies the time at which the flag monitor 

24 request was received. If the time stamps associated with the flag monitor requests in the spin list 1 8 

25 indicate that all of them (that is, the flag monitor requests) are relatively old, the spin daemon 1 7 can 

26 determine that it will likely be some time before any of the flags 16(n)(m) which it is monitoring is 

27 likely to be set. In that case, it can de-schedule itself and establish a timer set to expire after a 
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1 selected time interval. After the timer expires, the spin daemon 1 7 will resume execution determine 

2 whether any of the flags 16(n)(m) which it is monitoring have been set, and, if so enable itself to be 

3 re-scheduled and notify the process 1 2(n)(m) associated with the flag(s) 1 6(n)(m) which have been 

4 set. On the other hand, if the spin daemon 17 determines that none of the flags 16(n)(m) have been 

5 set, it can establish another timer and repeat the above-described operation. 

6 A process 12(n)(m) can generate a flag monitor request, transmit it to the spin daemon 17 

7 and de-schedule itself immediately after performing one or only a few spin-wait loops. 

8 Alternatively, the process 12(n)(m) may delay performing these operations for some time. In one 

9 embodiment, a process 12(n)(m) will generally delay for approximately the time required for the 

Q 

ig process 1 2(n)(m) to de-schedule itself and reschedule itself, which in one embodiment is on the order 
of twice the time required for a context switch at the end of a time slot. As a further alternative, a 

1J process 1 2(n)(m) may, after performing a selected number of spin- wait loops, give up the remaining 
portion of its current time slot, and repeat that operation for a selected number of subsequent time 

3 - slots during which it is executed before generating the flag monitor request, transmit it to the spin 

W daemon 17 and de-schedule itself 

g As described above, when the spin daemon 17 determines that a flag 16(n)(m) which it is 

monitoring has been set, it will transmit a message to the process 1 2(n)(m) associated therewith over 

1 8 the respective socket, which, in turn, enables the process 1 2(n)(m) to, in turn, enable itself to be re- 

19 scheduled. As an alternative, the spin daemon 17 itself can enable the process 12(n)(m) to be re- 

20 scheduled. In that case, the spin daemon will not need to transmit the message to the process 

21 12(n)(m), and the process 12(n)(m) will next be executed when the operating system 14 selects it 

22 from the task list 15 for execution. 

.23 As further described above, a process 12(n)(m) will perform a registration operation in 

24 connection with the spin daemon 17 prior to generating a flag monitor request for transmission to 

25 the spin daemon 1 7. A process 1 2(n)(m) may perform a registration operation at any point between 

26 the time the process 12(n)(m) is executed for the first time and the first time the process 12(n)(m) 
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1 is to transmit a flag monitor request to the spin daemon 17. If a process 1 2(n)(m) waits until the first 

2 time it is to transmit a flag monitor request to the spin daemon 17 to perform the registration 

3 operation, if the process 12(n)(m) never needs to make use of the spin daemon 17, it need not take 

4 the time to perform a registration operation. 

5 With this background, operations performed by a process 12(n)(m) and the spin daemon 1 7 

6 will be described in connection with the flow chart depicted in FIG. 2. With reference to FIG. 2, the 

7 process 12(n)(m) first initiates a registration operation with the spin daemon 1 7. In that operation, 

8 the process 1 2(n)(m) initially requests the operating system 1 4 to establish a socket between it (that 

9 is process 12(n)(m) and the spin daemon (step 100), After the operating system 14 provides a 
response to the process 12(n)(m) indicating that the socket has been established (step 101), the 

l;^ process 12(n)(m) generates a registration request, including its identification and the location of its 
li^ flag 1 6(n)(m) in the shared memory 13, and transmits the registration request over the socket (step 
1;!^ 102). The spin daemon 17 receives the registration request from the socket (step 103), load the 
. process identification and flag location information in a registration list 1 9 along with a handle (step 
IS 104), and generate a registration response including the handle for transmission to the process 
12(n)(m) over the socket (step 105). The process 12(n)(m), in turn, will receive the registration 
1% response (step 106) and store the handle for later use (step 107). 
"D 

1 8 After the process 1 2(n)(m) receives the handle fi-om the spin daemon 1 7, if it later determines 

1 9 that it is to generate a flag monitor request for transmission to the spin daemon 1 7 (step 1 1 0), it will 

20 generate the flag monitor request, including the handle (step 111), transmit it (that is, the flag 

21 monitor request) to the spin daemon 1 7 over the socket (step 1 12) and de-schedule itself (step 1 13). 

22 The spin daemon 17, in turn, receives the flag monitor request (step 1 14), uses the handle in the 

23 request to identify the location of the flag 1 6(n)(m) to be monitored in the common memory 1 3 (step 

24 115), and loads an entry into its spin Ust 18 for the request, identifying the location of the flag 

25 1 6(n)(m) to be monitored (step 1 1 6). 
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1 After the spin daemon 1 7 has loaded the flag monitor request entry into its spin Hst 1 8 in step 

2 1 16, it (that is, spin daemon 17) will iteratively sequence through the flag monitor request entries 

3 in the spin list 18, to determine whether the condition of any of the flags identified therein has 

4 changed fi^om the clear condition to the set condition (step 117). If, during processing operations 

5 in connection with step 1 1 7, the spin daemon 1 7 receives a registration request fi-om a process (step 

6 1 1 8) it will sequence to step 1 03 to handle the request.. Similarly, if, during processing operations 

7 in connection with step 1 1 7, the spin daemon 1 7 receives a flag monitor request fi-om a process (step 

8 119), it will return to step 1 10 to handle the flag monitor request. On the other hand, if, during 

9 processing operations in connection with step 1 1 7, the spin daemon 1 7 determines that the condition 
10^ of one of the flags 16(n')(m') has changed fi-om the clear condition to the set condition (step 120), 
1 Ifl it (that is, the spin daemon 1 7) will generate a notification for transmission to the process 1 2(n')(m*) 

associated with the flag (step 121) and transmit it (that is, the notification) over the socket to the 

13% process 12(n')(m') (step 122). Thereafter, the spin daemon 17 can return to step 117 to continue 

143] monitoring. 

1^2 After the process 12(n')(mO receives the notification transmitted in step 122 (step 123), it 

16^; (that is, the process 12(n')(m'), will enable itself to be re-scheduled (step 124) by requesting the 

173 operating system 14 to load information into the task list 15 which it (that is, the operating system 

1 8.3 14) uses to select processes for execution. Thereafter, at some point in the operating system 14 will 

19 select the process 12(n')(m*), among other processes which may be listed on the task list, for 

20 execution. 

21 The invention provides a number of advantages. In particular, the invention provides a 

22 computer that efficiently controls scheduling of execution of processes or threads comprising one 

23 or more parallel programs in a compute having a plurality of processors, such as a computer 

24 constructed according to a symmetric multi-processor architecture, or a cluster of such computers, 

25 when the processes or threads may be waiting for information fi-om other processes or threads. 
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1 It will be appreciated that a number of modifications may be made to the computer 10 as 

2 described above. For example, although the invention has been described in connection with a single 

3 computer, in the form of a symmetric multi-processor, it will be appreciated that the invention may 

4 be used in connection with a plurality of such computers interconnected by a network or other 

5 communication medium, and particularly if the computers are connected so as to organize their 

6 common memories as remote shared memories. In that case, each of the computers can include a 

7 respective spin daemon 17 which handles flag monitor requests in connection with processes and 

8 threads executing on the respective computer. In accordance with the remote shared memory 

9 architecture, the individual common memories of the respective computers are deemed to form a 
Ij^j single common memory across all computers, and, when a process on one computer sends 
\^ information to a process on another computer, a network interface on the one computer will intercept 
& the information and transmit it over the network to the other computer. A network interface on the 
1^ Other computer will then load the information into the portion of the common memory associated 

1 J with the destination process. Accordingly, a process on the one computer can enable information 

■•-^ 

requested by a process on another and enable the process's flag 1 6(n)(m) by performing operations 

Irg similar to those described above in connection with FIG. 1, and the network interfaces on the two 

Q computers will enable the information to be transferred to the other computer and the flag to be set. 

1%' The spin daemon 17 on the other computer can note that the flag has been set and perform the 

19 operations described above to enable the process to be re-scheduled. 

20 Furthermore, although the invention has been described with each process 12(n)(m) having 

2 1 one flag 1 6(n)(m), it will be appreciated that processes 1 2(n)(m) may have a plurality of flags whose 

22 condition can be monitored by the spin daemon 1 7. In that case, the processes 1 2(n)(m) can register 

23 each flag individually and receive a handle therefor from the spin daemon 17 for use as described 

24 above. Alternatively, if a process's flags are in a memory segment, and the segment only contains 

25 such flags, the process 12(n)(m) can register the memory segment and receive a handle for the 

26 segment. In that case, when the process 12(n)(m) issues a flag monitor request to the spin daemon 

27 17, the request is actually to monitor the entire segment, and, if a change occurs anywhere in the 



P3949 

-13- 

1 segment, the spin daemon 1 7 will enable the process 12(n)(m) to be re-scheduled, either by directly 

2 requesting the operating system 1 4 or by sending a message to the process 1 2(n)(m), which, in turn, 

3 can enable itself to be re-scheduled. 

4 In addition, as noted above, in one embodiment, the operating system 14 is a Unix-like 

5 operating system. In that embodiment, since each flags 16(n)(m) may take a number of forms, 

6 including an integer, a short- or long-word, or a range of addresses, and the like, and a variety of 

7 mechanisms may be used in changing a condition of a flag, in that embodiment the spin daemon 1 7 

8 is provided with mechanisms which can detect changes in value of the integer, short- or long-word, 

9 or the like, from or to a predetermined value, to a predetermined value. 

1 Furthermore, although the invention has been described in connection with processes which 

1 0 communicate using a message passing methodology, it will be appreciated that the invention can be 

\ % used in connection with processes which communicate using other methodologies. 

i f It will be appreciated that a system in accordance with the invention can be constructed in 

liD whole or in part from special purpose hardware or a general purpose computer system, or any 

15j combination thereof, any portion of which may be controlled by a suitable program. Any program 

ife may in whole or in part comprise part of or be stored on the system in a conventional manner, or it 

IS may in whole or in part be provided in to the system over a network or other mechanism for 

1 8 transferring information in a conventional manner. In addition, it will be appreciated that the system 

1 9 may be operated and/or otherwise controlled by means of information provided by an operator using 

20 operator input elements (not shown) which may be connected directly to the system or which may 

21 transfer the information to the system over a network or other mechanism for transferring 

22 information in a conventional maimer. 

23 The foregoing description has been limited to a specific embodiment of this invention. It will 

24 be apparent, however, that various variations and modifications may be made to the invention, with 

25 the attainment of some or all of the advantages of the invention. It is the object of the appended 
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claims to cover these and such other variations and modifications as come within the true spirit and 
scope of the invention. 



What is claimed as new and desired to be secured by Letters Patent of the United States is: 



